FREE EXPONENTIAL FAMILIES AS KERNEL 

FAMILIES 
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Abstract. Free exponential families have been previously intro- 
duced as a special case of the g-exponential family. We show that 
free exponential families arise also from the approach analogous to 
the definition of exponential families by using the Cauchy-Stieltjes 
kernel 1/(1 — Ox) instead of the exponential kernel exp(9x) . We use 
this approach to re-derive some known results and to study further 
similarities with exponential families and reproductive exponential 
models. 



1. Introduction 

Since the seminal work of Voiculescu [23], there has been a flurry 
of activity on how properties of free convolution \i ffl v of probability 
measures are similar to and how they differ from properties of classi- 
cal convolution fi * v. In particular, free probability analogues of the 
Central Limit Theorem, of the Poisson limit theorem, and the Levy- 
Khinchin representation of EB-infinitely divisible laws are now known, 
see [13] • New additional analogies between free and classical probabil- 
ity are developed in [U [5]. In this paper we study a free probability 
analogue of the concept of exponential family. 

Free exponential families were introduced in [TUl Definition 4.1] as 
part of a study of the relations between approximation operators, clas- 
sical exponential families and their q- deformations. An alternative ap- 
proach to free exponential families which we adopt in this paper em- 
phasizes similarities to classical exponential families, and is based on 
an idea of kernel family introduced in [25J. We show that the two ap- 
proaches are closely related, and that every non-degenerate compactly 
supported probability measure generates a free exponential family, see 
Theorem 13. 11 We then relate variance functions of free exponential 
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families to free cumulants. This relation is simpler than the corre- 
sponding relation for classical exponential families and is expressed by 
a concise formula. We apply the formula to compute free cumulants of 
the "free gamma" law which were stated without proof in [9], to derive 
simple necessary conditions for a smooth function to be the variance 
function of a free exponential family, and to investigate similarities with 
classical dispersion models [T5] . 

2. Cauchy-Stieltjes Kernel Families 

According to Wesolowski [25] , the kernel family generated by a kernel 
k(x, 9) consists of the probability measures 

{k(x,9)/L(9)v(dx) : 9 £ 0}, 

where L(6) = J k(x,9)u(dx) is the normalizing constant, and v is the 
generating measure. 

The theory of exponential families is based on the kernel k(x, 9) = 
e 9x . See, e.g., [15], [16], or [121 Section 2.3]. In this paper, we consider 
the Cauchy-Stieltjes kernel 



Definition 2.1. Suppose v is a compactly supported non-degenerate 
(i.e. not a point mass) probability measure. Let 



The Cauchy-Stieltjes family generated by v is the family of probability 
measures 



where G 3 is an open set on which M(9) is well defined, strictly 
positive and 9 supp(z/) C (— oo, 1). (We shall only consider 6 = (— e, e) 
with e > small enough.) 

Our first goal is to show that the Cauchy-Stieltjes family is essentially 
the same concept as the concept of free exponential family introduced 
in [10]. We begin with a suitable reparametrization of K,{i>] O). 

2.1. Parameterizations by the mean. From (12. ip we compute the 
mean m(9) = J xPg(dx). Since Pq = v we get m(0) = J xv[dx) = m 
and for 9 ^ 0, a calculation gives 





(2.1) 



m{9) 



M{9) - 1 
9M{9) 



(2.2) 
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Since M(0) = 1 and M{9) is analytic at 9 = 0, we see that m{9) is 
analytic for \9\ small enough. We have 

M(9) + 9M'{9) - (M(9)) 2 



m'(9) 

Since v is non-degenerate, 

M(6) + 9M'{9) - {M{9)) 2 

1 



9 2 (M(9)y 
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:i-^ Ax) -\j—^ Ax) ) >0 < 23 > 

for all |0| > small enough. Thus the function 9 \— > m(#) is increasing 
on an open interval containing 0. Denoting by ip the inverse function, 
we are thus lead to parametrization of a subset of K,(v, 0) by the mean, 

C{v) R) = {Q m {dx) = P^ m) {dx) :meR}, (2.4) 

where R = m(0 o ), and 6 C 6 is an appropriate interval with G Go- 
Notice that we refrain from claiming that (12.11) and (12.41) are equivalent: 
we only claim that for any pair of open sets 9 and R 3 mo, there 
are open sets 9o 9 and Rq 3 m such that C(y; Rq) C K.{y; 6), and 
K{v- O ) C £{v;R). 

The variance function of the Cauchy-Stieltjes family (12.41) is 

V(m) = J(x - m) 2 Q m {dx). (2.5) 

3. Relation to free exponential families 

The following generalizes slightly [TDl Section 4]; note that this defi- 
nition is not constructive: for a given V, the corresponding free expo- 
nential family may fail to exist, see Example 13.21 

Definition 3.1. The free exponential family with variance function V 
generated by a compactly supported measure v with mean m e (A, B) 
is a family of probability measures 

fm (V) = { ^ ( V{m) w Mdx): me(A,B)X. (3.1) 

^ V [m) + (m — mo) [m — x) J 

The next result shows that Cauchy-Stieltjes kernel families under 
parametrization by the mean are essentially the same as free expo- 
nential families, thus providing existence argument for free exponen- 
tial families. Furthermore, the generating measure v is determined 
uniquely by mo and the variance function Vim)] the latter is an ana- 
log of the classical uniqueness theorem for exponential families, see [T5| 
Theorem 2.11] or [TTJ, Proposition 2.2]. 
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Recall that the Cauchy-Stieltjes transform of a probability measure 
v is 

GJz) = [ -^—vidx). (3.2) 
J z- x 

If v is compactly supported then G v is analytic in the neighborhood of 
oo in the complex plane; in particular, compactly supported measures 
are determined uniquely by G u (z) for large enough real z. 

Theorem 3.1. Let {P e : 9 £ 0} be a Cauchy-Stieltjes family f l2.ll) 
generated by a non- degenerate compactly supported measure v with 
J xv[dx) = rriQ. Then there is a neighborhood (A,B) of mo in which 
the variance function V in (12.51) is analytic, strictly positive, and 

Vim) 

P« m) (dx) = V{m) + {m _ mo){m _ x f ( d *)> ™ e (A, B). (3.3) 

Conversely, if V is analytic and strictly positive in a neighborhood 
of mo, and there is a probability measure v with mean m such that the 
(positive) measures 

Q m {dx) = V( " m ' 1 -v(dx) (3.4) 

v[m) + [m — m ){m — x) 

are probability measures for all m in a neighborhood of mo, then v 
is compactly supported, non-degenerate, and is determined uniquely by 
(J3J2D with 

G„(z) = (3.5) 

with z = l/ip(m) = m + V(m)/ (m — mo). In particular, in a perhaps 
smaller neighborhood R of mo, probability measures (13. 4p for m G R 
are included in the Cauchy-Stieltjes family (12. 4p generated by v. 

Proof. We first calculate the variance v(9) = J x 2 Pg{dx) — m 2 (9) = 
J x(x — mo)Po(dx) — m{9){m{9) — m ). Since 

f (x -m )(9x - 1) +x -m 
x(x - mo)P e {dx) = J m{e){l _ dx) u ( dx ) 

m{9) — mo 
= 9 ' 

we see that for 9 ^ the variance is 

v{0) = (m(9) - m ) Q - m(9)) . (3.6) 

Since m(9) is analytic at 9 = and m(0) = m , this shows that that 
v(9) is analytic at 9 = 0. Let V{m) = v(jp(m)) denote the variance 
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function in parametrization of (a subset of) K, by the mean; clearly V 
is an analytic function in a neighborhood of m = m . 

Now (JSID implies {m{6)-m ) /v{6) = 0/(1 -0m(0)) and (Q implies 
1 - 9m(6) = 1/M(6), so (JOJ) is equivalent to 

gm(e)(rfx) = 1 + ( m (0) - x)(m(0) - m )/.(< (<lx) 

1 - 0m(0) 1 ~ Mg) 

-v(ax) = z/(ctx) 



1 - 0m(0) + (m(0) - x)0 v ' I -Ox 

= M(6)(i-ex) u{dx) = P9{dx) - 

To prove the converse implication, note that for m such that V(m) > 
we can re- write J Q m (dx) = 1 as 



/ 



1 m-m 
v{dx) 



V (m) j (m — mo) + m — x V(m) 
Thus with 

z = m+ V(m) , (3.7) 
m — mo 

we get (13.51) . Since lim m ^ m ± V{m)/{m — m Q ) = ±oo, this shows that 

Cauchy-Stieltjes transform G u (z) is defined for all real z with \z\ large 
enough. This implies that v has compact support, with moments that 
are uniquely determined from the corresponding moment generating 
function M(z) = \jzGi\jz) for z small enough. (Compactness of 
support is also proved more directly in the proof of Theorem 13.31 ) 
Finally, v is non-degenerate as its variance is V{m§) > 0. 

□ 

Remark 3.1. Solving equation (13. 6p for 9 we see that 

m-m 

= ~7 \,-tsf v 

m(m — m ) + V (m) 

Thus a necessary condition for V to be a variance function is that 
m i— > m + V A (m)/(m — mo) is decreasing in a neighborhood of mo, see 
(ED- 

3.1. Free exponential families with quadratic variance func- 
tion. In this section we recall [TQj, Theorem 4.2 ]; since manuscript 
[10] is available in preprint form only and we have already set up all 
identities needed for the proof, we include the argument which is taken 
from [10]. The corresponding result for classical exponential families 
is [TJJ Theorem 3.3] and [T8J Section 4]; the result for g-exponential 
families is ITOl Theorem 3.2 1. 
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Theorem 3.2 ( [TOl Theorem 4.2 ]). Suppose b > — 1, mo = 0. The 

free exponential family with the variance function 

V{m) = 1 + am + 6m 2 
consists of probability measures H3.4[) with generating measure 



U ( dX ) = 2 7T(to 2 + OX + 1) l ^VT+b,a+2Vl+b) dx + PlQ*x +P 2 5x 2 , 

(3.8) 

where the discrete part of v is absent except for the following cases: 

(i) if b = 0, a 2 > 1 ; i/ien pi = 1 — 1/a 2 , x\ = — 1/a, p 2 = 0. 

(ii) if b > and a 2 > 46, i/ien pi = max jo, 1 — ^^S-tb y ^ 2 = 

0, and x\ = j- Hn^E H ^ e s {g n opposite to the sign of a. 

(iii) if — 1 < b < £/ien t/iere are £u>o atoms at 



—a±\/a 2 — 4b a/o 2 — 46 + a 

Xl,2 = , Pl,2 = 1 + — -===-. 

26 26Va 2 - 46 

Proof. With mo = and V(m) = 1 + am + 6m 2 , equation (13.71) can be 
solved for m, giving 



m 



z-a-J(a-z) 2 -4 (1 + 6) 



2 (1 + 6) 
so (13.51) gives 



a + ,2 + 2 6,2 - J(a-zf -A (1 + 6) 

G ^> = 2(1+0, ' (3 ' 9) 

This Cauchy-Stieltjes transform corresponds to the free-Meixner law 
(ESD, see PEI]. □ 

Theorem [3T2] results covers a number of important laws that appeared 
in the literature. Up to a dilation and convolution with a degenerate 
law 5 a (i.e. up to "the type") the generating measure v is: 

(i) the Wigner's semicircle (free Gaussian) law if a = b = 0; see 
[21 Section 2.5]; 

(ii) the Marchenko-Pastur (free Poisson) type law if 6 = and 
a ^ 0; see [22 Section 2.7]; 

(iii) the free Pascal (free negative binomial) type law if 6 > and 
a 2 > 46; see [HJ Example 3.6]; 

(iv) the free Gamma type law if 6 > and a 2 = 46; see [9J Propo- 
sition 3.6]; 
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(v) the free analog of hyperbolic type law if b > and a 2 < 46; see 
PQ Theorem 4]; 

(vi) the free binomial type law if — 1 < b < 0; see [2lT Example 3.4] 
and [9j Proposition 2.1]. 

The laws in (i)-(v) are infinitely divisible with respect to free additive 
convolution (we recall the definition near (13.171) ). In P, Theorem 4] 
they appear in connection to martingale polynomials with respect to 
free Levy processes; free infinite divisibility is analyzed also in [21] ; 
12 j studies further free probability aspects of this family; in [91 Theo- 
rem 3.2] the same laws appear as a solution to a quadratic regression 
problem in free probability; in [ITJ Theorem 4.3] these laws occur in a 
"classical regression" problem. 

3.2. Free Cumulants and Variance Functions. Recall that if v is 
a compactly supported measure with the Cauchy-Stieltjes transform 
G u , then the inverse function K v {z) = G~ 1 {z) exists for small enough 
z 0, see [21]. The i?-transform is defined as 

R v {z) = K v {z) - l/z (3.10) 

and is analytic at z = 0, 

oo 

R u {z) = ^2c n {u)z n -\ (3.11) 

n=l 

The coefficients c„ = c n {y) are called free cumulants of measure u, see 



The following result extends [TDJ, Remark 4.4] and plays a role anal- 
ogous to J0rgensen's theorem [T71 Theorem 3.2]. (For the formula 
connecting classical cumulants with the variance functions of natural 
exponential families, see [18l (2.10)] or [15l Exercise 2.14].) 

Theorem 3.3. Suppose V is analytic in a neighborhood of mo, 
V(mo) > 0, and v is a probability measure with finite all moments, 
such that J xv{dx) = m . Then the following conditions are equiva- 
lent. 

(i) v is non- degenerate, compactly supported, and there exists an 
interval (A, B) 3 itlq such that (13.11) defines a family of prob- 
ability measures parameterized by the mean with the variance 
function V . 

(ii) The free cumulants (13.111) of v are c\ = m 0; and for n > 1 



1 d n ~ l 
C " +1 = n\ {V(x)r 



(3.12) 

=m 
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Proof. Suppose that V determines the free exponential family gener- 
ated by a compactly supported measure v. For m^fl close enough to 
0, from (I3.5P and (13.71) we get 

V(m) f m — mn 

m + = K u 1 



m — m \ V{m) 

Thus, ( I3.10P says that the i?-transform of v satisfies 

( m — mn \ 

Mw) =m - (313) 

From this we derive (13. 12[) by using the Lagrange expansion theo- 
rem, which says that if cj){z) is analytic in a neighborhood of z = tuq, 
0(m o ) 7^ and £ := (m — mn)/0(m) then 



m(0 = m + V — 



n! 

n=l 



1 (3.14) 



dx 



n-l 



x=m,Q 



(See, e.g., [Sffl (L), page 145].) 

Suppose now that a probability measure v satisfies ( I3.12p and 
J xu(dx) = mo- Then the variance C2{y) = V(mo) > 0, so v it is 
non-degenerate. We first verify that v has compact support. Since V 
is analytic, (I3.12p implies that 

c„+i = I V(z) n /(z - mo)"" 1 , (3.15) 

2imi i| 2 _ mo | =5 

so there exist M > such that \c n \ < M n for all n > 1. The compact- 
ness of support follows now from [6, Corollary 1.6]; for completeness we 
include the proof. Denoting by MC[n] the set of non-crossing partitions 
of {1, 2, ... , n}, from [TJ (2.5.8)] we have 

fx^{dx)= U c m< M2n *m2n}=M^^(f); 

for the last equality, see [331 (2.5.11)]. Since the m-th Catalan number 
is less than 4 m , 

/ r \V(2n) 

limsup ( / \x\ 2n u(dx) ] < 4M < oo, 

and v has compact support. 

From supp(z/) C [— 4M, AM] we deduce that the Cauchy-Stieltjes 
transform G u (z) is analytic for \z\ > AM, and the i?-series is analytic 
for all \z\ small enough. 
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Since V(m) > for m close enough to mo, taking the derivative we 
see that z i— > [z — m ) /V(z) is increasing in a neighborhood of z = m . 
Denoting by h the inverse, we have 



m 



V(z) 

From ci(u) = m we see that R(0) = m = h(0). By (13.141) . we see 
that all derivatives of h at z = match the derivatives of R. Thus 
h(z) = R(z) and (13.131) holds for all m in a neighborhood of 0. For 
analytic G u , the latter is equivalent to (13.41) holding for all m close 
enough to 0. Thus V(m) is the variance function of a free exponential 
family generated by v with m G (—5, 5) for some 5 > 0. □ 

We now use (13.121) to relate certain free cumulants to Catalan num- 
bers. 

Corollary 3.4. [9J Remark 5.7] If v is the standardized free gamma 
Meixner law, i.e. it generates the free exponential family with m = 
and variance function V{m) = (1 + am) 2 , then its free cumulants are 

This fact was stated without proof in [91 Remark 5.7]; the approach 
indicated there lead to a relatively long proof. 



Proof. From fl3TT2|) . 



2k 



fc _ 1 2fc(2fc - 1) . . . (fc + 2) 



x=0 hj - 



a*- 1 (2k)\ 
~ k+1 (fc!) 2 ' 

□ 

Recall that the free additive convolution of compactly supported 
probability measures fi, v is a unique compactly supported measure 
denoted by /x EB z/ with the /^-transform 

= R„{z) + i?^). (3.16) 

(See [23J . ) Equivalently, free cumulants linearize free convolution, 

c n (p EB v) = c n (fi) + c n (u), n > 1 (3.17) 

just like classical cumulants linearize the classical convolution. Recall 
that fi is EB-infinitely divisible if for every n = 1,2,..., there is a 
measure v such that /z = z/EBz/EB---EBz/ (the n-fold free convolution). 
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Corollary 3.5. V(m) = 1/(1 —m) is a variance function of a free ex- 
ponential family generated by the centered ^-infinitely divisible measure 
v with free cumulants 



2k 
k- 



k > 1. 



Proof. From fl3TT2|) . 
1 d k ~ x 



Cfc+l 



k\ dx k 



1 



x) 



k{k + l)...{2k-2) 1 (2k-2)\ 



x=0 



k\ 



k((k-iy.y 



It is well known that Catalan numbers are even moments of the semi- 
circle law, 



Therefore, R{z) 



x 



2/,- 



X' 



-2 



2tt 



Eoo 



Jo 1- 



2tt 



a/4/x-I 



^ ~~ Jo 1- 



2tt JO 1-zic 2?r 

corresponds to ffl-infinitely divisible law, see [TBI Theorem 3.3.6]. Thus 
Catalan numbers c^+i with ci = are indeed free cumulants of some 
ffl-infinitely divisible measure v. □ 

It is known that not every function V is a variance function of a 
natural exponential family. It is therefore not surprising that not ev- 
ery analytic functions V can serve as the variance functions for a free 
exponential family. 

Corollary 3.6. Suppose V is analytic at and V(0) = 1, V"(0) < —2. 
Then V cannot be a variance function of a free exponential family with 
m = 0. 

Proof. Suppose V generates a free exponential family with generating 
measure v. Let rrij = J x^vidx) with m\ = 0, m 2 = 1. Then the 3x3 
Hankel determinant is 



det 



1 mi m 2 
nil m 2 m 3 
m 2 m 3 m 4 



det 



1 

1 m 3 
m 3 m 4 



m 4 — rrin — 1 > 0. 



Using (I3.12p . the fourth moment is 



m 4 = C4 (i,) + 2c 2 2 (u) = c 4 (» + 2 = V'(0) 2 + -V"(0) + 2 



and m 3 = c 3 (v) = V'(0), see p, (2.5.8)]. Thus m 4 
translates into V"(0) > -2. 



- 1 > 
□ 
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Example 3.1. If b < — 1, then V(m) = 1 + am + bm 2 is not a variance 
function of a free exponential family with m = 0. Compare Theorem 
13.21 (This can also be seen from Remark 13.11 ) 

Example 3.2. V(m) = (1 — m)/(l + m) is not a variance function of 
a free exponential family with m = 0. (This can also be seen from 
Remark 13.11 ) 

Combining (13.121) with the ffl-Levy-Khinchin formula [121 Theorem 
3.3.6], compare [21 Lemma 3.4], we get also the following. 

Corollary 3.7. Suppose V(m) is analytic at 0, V(0) = 1. Then the 
following conditions are equivalent. 

(i) There exists a centered ^-infinitely divisible probability mea- 
sure v such that V is the variance function of a free exponential 
family generated by v. 

(ii) There exists a compactly supported probability measure to such 
that 



The Cauchy-Schwarz inequality applied to the right hand side of 
the Levy-Khinchin formula fl3TT8l) implies (V 3 )" '/6 > ((V 2 )') 2 /A. This 
gives a simple necessary condition. 

Corollary 3.8. If V is analytic at 0, V(0) = I, V"{$) < then V 
cannot be the variance function of a free exponential family generated 
by a centered ^-infinitely divisible measure. 

We remark that the bound is sharp: from Theorem 13.21 we see that 
V(m) = 1 is a variance function of the free exponential family generated 
by the semicircle law; all of its members are infinitely divisible, see 
Example 14.11 

Example 3.3 (Compare [211 Theorem 3.2]). If b < then V(m) = 
1 + am + bm 2 cannot be the variance function of a free exponential 
family generated by a centered EB-infinitely divisible measure. 

3.3. Reproductive property. Natural exponential families have two 
"reproductive" properties. The first one is usually not named, and says 
that if a compactly supported measure v generates natural exponential 
family T and /x G T{y) then Tip) = T . This is usually interpreted as 
a statement that the natural exponential family T is determined solely 
by the variance function V and can have many generating measures. 




(3.18) 
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The analog of this property fails for free exponential families due 
to the fact that the generating measure is determined uniquely by the 
variance function and parameter m . For example, a free exponential 
family T generated by the centered semicircle law consists of the affine 
transformations of the Marchenko-Pastur laws, and for m 7^ the 
free exponential family generated by /x G T with mean itlq contains no 
other measures in common with T except for /x. 

The second property which in [T5J (3.16)] is indeed called the repro- 
ductive property of an exponential family states that if /x G T{V\ then 
for all n G N the law of the sample mean, D n (fi* n ), is in TiV/n). Here 
D r (fi)(U) := fi(rU) denotes the dilation of measure /1 by a number 
r 7^ 0; in probabilistic language, if C(X) = fi then C(X/r) = D r (/i). 

Our goal is to prove an analogue of this result for the Cauchy-Stieltjes 
families. 

Let /x fflr denote the r-fold free additive convolution of /x with itself. 
In contrast to classical convolution, this operation is well defined for 
all real r > 1, see 



Proposition 3.9 ([10., Proposition 4.3]). // a function V analytic at 
m is a variance function of a free exponential family generated by a 
compactly supported probability measure v with m = / xv{dx), then 
for each A > 1 there exists a neighborhood of m such that V/X is the 
variance function of the free exponential family generated by measure 

u x := D x (u ax ). 

Moreover, if for each A > 0, there is a neighborhood of m such that 
V/X is a variance function of some free exponential family, then v is 
^-infinitely divisible. 

We note that in contrast to classical natural exponential families, the 
neighborhood of mo where m > V(m)/X is a variance function may 
vary with A, see Example 14.11 

Proof. Combining (I3.12p with R a x+b( z ) = b + aR x (az), we see that 
the free cumulants of v\ are c\(v\) = C\(v) = m and for n > 1 

1 1 d n ~ l fV(x 



Cn+AVx) = —c n+1 {v 



A" ™ ' n\d.r» ' V A , 

Theorem 13.31 implies that V/ X is the variance function of the free ex- 
ponential family generated by i>\. 

If v\j n exists for all n G N, then the first part of the proposi- 
tion together with uniqueness theorem (Theorem 13. ip implies that 
v = (D n (i>i/ n )) mn , proving ffl-infinite divisibility. □ 
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4. Marchenko-Pastur Approximation 



Let 



uj a>a (dx) 



a/40- 2 - (x - a) 2 
2^ 



\x-a\<2adx 



denote the semicircle law of mean a and variance a 2 . Up to affine 
transformations, this is the free Meixner law which appears in Theorem 
13.21 as the law which generates the free exponential family FaiV) with 
the variance function V = a 2 . 

Following the analogy with natural exponential families, family ^ r ( (j2 ) 
can be thought as a free exponential analog of the normal family. Some- 
what surprisingly, this family does not contain all semicircle laws, but 
instead it contains affine transformations of the (absolutely continuous) 
Marchenko-Pastur laws. 

Example 4.1 (Semi-circle free exponential family). For A > 0, let 



Function V(m) = 1/A is the variance function of the free exponential 
family 



explicit form of the density [131 (3.3.2)] to note that 7r m A = C(m + 
l/(Am) — mX) is the law of the affine transformation of a free Pois- 
son (Marchenko-Pastur) random variable X with parameter l/(Am 2 ). 
From the properties of Marchenko-Pastur law we see that J ir m) \(dx) = 
1 iff m 2 < 1/A, so for large A the interval (A, B) C (-1/VA, l/v 7 ^) in 
(13.11) cannot be chosen independently of A. 

We remark that Biane [7] analyzes / i— > g(m) := J f (x)7r m> \(dx) as 
a mapping of the appropriate Hilbert spaces for complex m. 

We have the following analogue of [T5J, Theorem 3.4]. 

Theorem 4.1 (Marchenko-Pastur approximation). Suppose the vari- 
ance function V of a free exponential family J- mo (V) is analytic and 
strictly positive in a neighborhood of ijiq . Then there is 5 > such that 
if £(Y\) G Fm^iV/X) has mean E(Y\) = m + mj\f\ with \m\ < 5, 

then v / A(Xx - mo) ^ ^m,i/v(m ) as A -» oo. 

To prove Theorem 14.11 we will use the following analogue of Mora's 
Theorem, see [T5l Theorem 2.12], or [TT], Theorem 2.6]. 



\/A\/4 - Ax 2 



la; 2 <4/A^- 



27r(l + Am(m — x)) 
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Proposition 4.2. Suppose V n is a family of analytic functions which 
are variance functions of a sequence of free exponential families 
{^moiVn) '■ n > 1}. If V n —> V uniformly in a (complex) neighbor- 
hood of m G R, and V(too) > ; then there is 5 > such that V is 
a variance function of a free exponential family T mQ {y) parameterized 
by the mean m G (mo — 5, itlq + 5) . Moreover, if a sequence of measures 
£ J~m (yn) is su °h that mi = f xfj, n (dx) G (m — S, mo + 5) does 



not depend on n, then ji n — > // where /i G T mo (y) has the same mean 
J xfi(dx) = mi. 

Proof. Let v n be the generating measure for J r mo (V n ). Since V n (z) — > 
V(z) uniformly in a neighborhood of niQ, from (I3.15P we see that the 
cumulants Ck+i(u n ) converge as n — > oo and sup n |cfc+i(^„)| < M k for 
some M < oo. Therefore the /^-transforms of u n converge to the R- 

transform of a compactly supported measure v. Thus v n ^ u, and the 
supports of v n are uniformly bounded in n, i.e., supp(z/ n ) C [—A, A] 
for some < A < oo. By decreasing the value of 6 we can also ensure 
that the densities in (13.41) are bounded as functions of x G [—A, A] 
uniformly in n. So the integrals converge, and v indeed generates a 
free exponential family with variance V in a neighborhood of m . 

Suppose now \i n G J r mo (V n ) and fi G J r mo {V) have the same mean m 
for some \m — nio\ < 5 small enough. Since the densities in (13.41) are 
bounded by some constant C for all x G [—A, A], n G N, for a bounded 
continuous function g we have 

g(x)fi n (dx) = [ g{x) v n(m) -v n (dx) 

J V n (m) + (m — m )(m — x) 

9{X) rV n {dx) + En 

V [m) + [m — mo){m — x) 

9{x) V ^ -v(dx) = [ g(x)fi(dx) 

V [m) + [m — m ) [m — x) J 



as n —>■ oo, where 



V n {m) 

o)(m - x) 

)u n (dx) 



V n {m) + (m — m )(m — x) 
V(m) 



V(m) + (m — mo) (to — x) ' 



2 \V n (m) — V (to) I 

<C \m-m \ sup \g(x)(m-x)\ > 0. 

xe[-A,A] V n {m)V{m) 



□ 
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Proof of Theorem \4-l\ Without loss of generality, we assume itlq = 0. 
Suppose fi G F(V). A change of variable shows that D a (/i)(dx) G 
jF(V(am)/a 2 ), with generating measure v a = D a (v). Since 

C(Y„) e T < V{m) 

this shows that 



A 



£(VaV a ) G ^ ( 



We now use Proposition 14.21 to the sequence of variance functions 
Vx(m) = V -> V(0) = (x 2 as A -> oo. From Proposition |~2] we 

deduce that there is < 5 < a 2 such that if \m\ < 5 and E(y/XY\) = m, 
then C(y/XYx) ^ ir m>1/(T 2 G ^o(^ 2 ), see flU}. □ 



By Example 14.11 if < \m\ < cr, then up to affine transformation 
T^mii a 2 is a Marchenko-Pastur law. Thus in this case Theorem 14. II gives 
a Marchenko-Pastur approximation to £(Yx). 

Of course, every compactly supported mean-zero measure v is an 
element of the Cauchy-Stieltjes family that it generates. Since 7r 1/^2 = 
u;o,cr is the semicircle law, combining Proposition 13.91 with Theorem 14.11 
we get the following Free Central Limit Theorem; see [SJ [23] ■ 

Corollary 4.3. If a probability measure v is compactly supported and 
centered, then with a 2 = J x 2 v{dx) we have 

Acknowledgements. The author thanks J. Wesolowski for the copy 
of [23] and for several helpful discussions. He also thanks the referee for 
an insightful report which helped to clarify the statement of Theorem 
13.11 and led to significant improvement of the paper. 
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